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This  volume  serves  as  an  addendum  to  the  four  volume  technical 
report  (RADC-TR-76-224)  which  describes  the  Waveform  Processing 
System.  This  system  was  developed  by  the  Pattern  Analysis  and 
Recognition  Corporation  (PAR)  under  contract  F30602-72-C-0193.  The 
additional  work  described  in  this  report  was  performed  by  PAR  under 
contract  F30602-76-C-0373. 
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EVALUATION 


This  report  describes  additions  and  modifications  made  to 
the  Waveform  Processing  System  (WPS).  Based  upon  use  of  the  WPS 
system  for  actual  problem  solving,  new  options  which  would  enhance 
the  systems  capabilities,  reduce  times  necessary  for  data  manipulation, 
and  improve  efficiency,  were  designed.  This  report,  serving  as  an 
addendum  to  the  four  volume  Waveform  Processing  System  technical 
renert/) discusses,  the  implementation  of  those  options. 


BHN  VASSELLI,  Capt,  USAF 
fnteractive  Processing  Section 
Computer  Technology  Branch 
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SECTION  1 
INTRODUCTION 


During  the  latter  stages  of  the  initial  WPS  contract,  as  more  and  more 
time  was  being  spent  actually  solving  pattern  recognition  problems,  it  was 
noted  that  many  things  could  be  done  to  improve  the  overall  system  perfor- 
mance. New  options  were  identified  which  would  reduce  the  time  necessary  for 
data  manipulation,  and  changes  were  noted  which  would  improve  the  efficiency 
of  the  operating  system.  It  was  due  to  these  new  thoughts,  gained  through 
experience,  that  led  to  the  creation  of  this  follow-on  effort. 
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SECTION  2 


2.1.  TRAP  HANDLING 

When  the  WPS  system  was  first  actually  utilized  as  a pattern  recognition 
tool,  it  was  discovered  that  hardware-generated  error  traps  were  not  being 
handled  properly.  When  a trap  generation  sequence  occurred,  the  system  could 
not  recover  since  WPS  is  a stand  alone  system,  and  as  such,  does  not  communi- 
cate with  the  trap  handler  in  DOS.  This  correction  received  high  priority 
since  the  location  and  identification  of  a trap,  plus  the  ability  to  automati- 
cally recover,  are  essential  to  the  overall  system  efficiency. 

The  "WAVEFORM  PROCESSING  SYSTEM"  now  handles  all  traps  that  are  generated 
by  the  11/45  hardware.  At  run  time,  the  "DOS"  interrupt  vectors  are  replaced 
by  vectors  which  point  to  the  "WPS"  trap  handler,  located  in  the  executive 
monitor  routine. 

When  a trap  occurs,  control  is  restored  to  the  waveform  processing  system, 
and  the  error  message  is  displayed  on  the  Tektronix  and  "VG".  At  this  point, 
the  executive  also  closes  all  open  files,  to  insure  a high  level  of  filing 
system  integrity. 

The  following  list  enumerates  the  "WPS"  trap  messages. 


2-1 


t 


1. 


Trap  4 

a)  Odd  Address. 

b)  Parity  Error. 

c)  Stack  Violation. 


2 . Trap  10 

a)  Illegal  Instruction. 

3.  Trap  250 

a)  Memory  Management  Error. 

2.2.  TREE  TABLE  REDUCTION 


When  storing  large  amounts  of  data  on  the  WPS  system  disk,  we  discovered 
that  the  filing  system  tables  seemed  to  overflow  prematurely.  It  was  decided 
that  the  storage  capabilities  of  the  system  could  be  enhanced  by  analyzing  the 
sector  allocation  mix  pertaining  to  the  various  filing  system  tables. 

The  resulting  changes  are  invisible  to  the  user,  but  they  greatly  enhance 
the  system  capabilities.  As  data  accumulates,  one  of  the  first  tables  to 
overflow  is  the  "SECTOR  TABLE".  It  tells  how  each  file  is  segmented  on  the 
RP02.  By  taking  the  "TREE  TABLE"  allocation  of  four  sectors,  and  cutting  it 
to  two  sectors,  we  can  then  assign  another  sector  to  the  "SECTOR  TABLE",  thus 
doubling  its  size.  The  other  sector  was  assigned  to  the  "USAGE  ELEVEN"  table, 
doubling  its  size  also.  This  table  is  used  to  keep  track  of  the  free  space 
on  the  disk.  Since  the  "TREE  TABLE"  is  tree  specific,  and  both  the  "SECTOR" 
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6 "USAGE  ELEVEN"  tables  are  system  specific,  this  change  increases  the  amount 
of  data  which  can  be  stored  -onder  WPS  by  at  least  50%.  We  will  pay  for  the 
loss  of  two  "TREE  TABLE"  sectors,  however,  in  that  the  number  of  nodes  that 
can  be  located  under  a senior  node  is  reduced  from  199  to  99.  This  restric- 
tion seems  to  be  of  little  consequence,  however,  since  in  the  normal  collec- 
tion and  digitization  of  data  it  is  very  rare  to  have  greater  than  99  sub- 
classes under  a given  class. 

If  data  should  accumulate  to  the  point  where  a filing  system  table  does 
overflow,  the  user  is  warned  via  a message  appearing  on  the  vector  general. 
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3.1.  PARLAN  PREDICATES 


■ 

The  addition  of  a high  level  language  to  a system  represents  a quantum 
jump  in  the  ease  by  which  users  can  implement  their  own  software.  No  longer 
is  it  necessary  to  learn  assembly  language  or  the  ins  and  outs  of  a complex 
I/O  structure.  To  even  further  aid  in  program  development  the  "PARLAN  Predi- 
cates" were  designed.  They  represent  the  most  extensive  group  of  new  options 
implemented  under  the  effort. 

I The  following  routines  were  written  with  the  hope  that  they  would  repre- 

j 

I , 

sent  some  of  the  most  frequently  needed  algorithms  for  waveform  processing 
[ work.  They  represent  only  the  start  of  what  the  user  can  create  with  the 

i; 

[ "PARLAN  LANGUAGE". 

i 

f The  following  predicates  are  available  with  the  WPS  system: 

I 

t 

‘ 1.  "SMODIF" 

I 

a.  averages  over  a window  of  two  (3  points)  with  rectangular 
weighting. 

b.  computes  the  first  forward  difference. 
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2. 


"AMFRA"  - extracts  nine  features  from  an  amplitude  modulated 
waveform . 


a. 

pulsewidth 

b. 

rise  time 

c. 

fall  time 

d. 

peak  to  90%  time 

e . 

first  peak  to  first  valley 

f. 

percent  ripple 

g- 

first  valley  to  second  peak 

time 

h. 

percent  first  valley  to  second  peak 

i. 

slope  of  line  from  first  to 

second  peak  such  that  if 

y'  = 0 heights  are  equal. 

3.  "POWER"  - computes  the  power  spectrums  over  a sliding  window. 

4.  "LOGIC"  - computes  the  log  base  ten  of  a number. 

5.  "INFLEX"  - computes  the  inflection  points  in  a waveform. 

6.  "CONVPT"  - converts  a time  to  an  ordinal  point  count  relative 
to  the  beginning  of  a waveform. 

7.  "FIX"  - output  is  integer  part  of  input  X^  = [X^] 

8.  "SQRT"  - output  is  square  root  of  input  X^  = X^ 


9.  "POWER  (F1;F2;F3)  - Fe  = Fl^^ 

10.  "LOGIC  (F1;F2)  - F2  = log^^  FI 

11.  "IBITR"  - performs  a bit  reversal  of  the  type  required  to 
unscramble  the  results  of  an  FFT. 

12.  "SAMP"  - samples  of  waveform. 

13.  "WAVSUM"  - calculates  the  summation,  integral,  average, 
and  energy  of  a waveform. 

14.  "DIF"  - computes  the  first  or  second  forward  difference  of 
a waveform. 

15.  "SHIFT"  - shifts  the  waveform  by  an  integral  number  of  samples. 

16.  "RECWAV"  - performs  a full  or  half  wave  rectification  on  the 
waveform. 

17.  "ADDSUB"  - adds  any  fraction  of  one  waveform  to  another  waveform. 

18.  "HSTGRM"  - computes  the  histogram  of  a waveform. 

19.  "ZRCRSL"  - cor.puces  the  zero  crossing  locations  of  a waveform. 
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20.  "FRDMOD"  - not  yet  debugged  — frequency  demodulation. 


21.  "COSSIN"  - COS  or  SIN 


X„  = COS  X,  or  X„  = SIN  X. 
0 1 0 1 


22.  "TAN"  - TAN 


X„  = TAN  X. 
0 1 


23.  "EXP"  - exponential 


24.  "LN"  - logarithm 


25.  "ARCTAN"  - TAN 


26.  "HYP"  - COSH  or  SINH 


27.  "ARSINH"  - SINH 


Xq  = e Xi 

Xo  -in  X. 

X = TAN"^  X. 

0 1 

X„  = COSH  X,  or  X„  = SINH  X. 
0 10  1 

X„  = SINH“^  X. 

0 1 


28. 


"SMOOTH"  - Does  all  or  any  of  the  following: 
o Truncates  the  waveform, 

o Resamples  the  waveform. 

o Smooths  the  waveform  by  applying  a sliding  window. 
Possible  window  choices  are: 
oo  Rectangular 
oo  Triangular 
oo  Hanning 
oo  Hamming 
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29.  "REDUCE"  - Does  any  or  all  of  the  following: 
o Truncates  the  waveform, 

o Resamples  the  waveform. 

o Reduces  the  dynamic  range  of  the  waveform. 


30. 


33. 


o Walsh  Transform. 


31.  o Shift  Waveform  an  Integral  Number  of  Samples. 


32.  o Find  Extrema  (ordered  by  location). 


o FFT 


3.2.  DISPLAY  A PRIORI  MARKERS 


This  new  option  allows  the  user  to  display  a waveform  in  the  same  manner 
as  under  the  Single  Display  Frame,  but  with  one  exception.  Superimposed  on 
the  display  are  up-arrows  indicating  the  beginning  and  end  of  the  a priori 
segmentation  markers,  located  in  the  waveform  header.  This  is  very  useful  as 
it  allows  the  user  to  visually  confirm  the  location  of  the  markers  before 
actually  performing  the  editing  in  the  Segmentation  frame.  The  markers  may 
be  erased  and/or  inserted  under  the  Editing  frame. 


I 
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3.3. 


DELETE  VECTOR 


This  routine  will  delete  one  vector  or  a range  of  data  vectors  from  a 
given  data  set.  The  user  must  specify  the  "ID"  or  range  of  "ID's"  to  be 
deleted. 

3.4.  DELETE  VECTOR  NODE 

As  the  name  implies,  this  "VG"  light  button  option  will  allow  the  user 
to  delete  a node  from  a given  vector  data  tree. 

3.5.  APPEND  FEATURE  VECTORS 

This  option  allows  the  user  to  combine  the  vectors  in  two  given  trees, 
with  the  same  structure.  See  Figure  7-7  in  Vol.  I - RADC-TR-76-224. 

3.6.  SORT  WAVEFORMS 

The  routine  allows  the  user  to  sort  waveforms  from  a given  tree  into  a 
new  tree,  each  node  of  which  represents  one  of  the  new  classes.  The  user  may 
sort  using  temporary  symbols,  ID's  or  fields  within  the  ID.  See  Figure  7-8, 
RADC-TR-76-224,  Vol.  I - WPS  Final  Report. 
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SECTION  4 


OPTION  IMPROVEMENTS  j 

oo  DELETE  TREE 

This  routine  was  awkward  to  use  for  OLPARS  data  in  that  it  did  not 
delete  the  mean  covariance  files  associated  with  the  tree.  The  user,  there- 
fore, was  left  to  delete  each  file,  one  by  one,  using  DELETE  FILE.  DELETE 
TREE  was  modified  under  this  contract  so  that  when  the  user  invokes  this 
option  on  OLPARS  data  the  mean  covariance  files  are  automatically  deleted. 

oo  DELETE  SUBSTRUCTURE 

This  option  which  concatenates  all  of  the  substructured  data  under  a 
senior  or  lower  node  into  one  user  specified  lowest  node  did  not  function  due 
to  the  filing  system  changes  which  were  invoked  under  the  initial  effort. 

Modifications  were  made  to  reactivate  this  useful  file  utility. 

oo  LODWAV 

This  overlay  allows  the  user  to  read  waveform  data  into  the  system  from 
magnetic  tape.  It  was  originally  written  such  that  the  data  could  only  be 
stored  in  a one  tree  per  tape  format  — very  inefficient!  The  routine  was 
modified  so  that  any  number  of  waveform  trees  can  be  read  in  from  one  tape. 
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oo  OLPARS  LIGHT  PEN  OPTIONS 


Long  range  plans  see  the  WPS  system  being  implemented  on  other  systems 
which  are  similar,  but  not  exactly  equivalent  to  the  original  at  RADC.  For 
this  region  every  effort  was  made  to  design  routines  which  are  as  flexible  as 
possible.  The  Vector  General  display  has  two  different  subroutine  calling 
options,  each  requiring  different  software.  For  this  reason  all  of  the 
OLPARS  options  which  utilize  these  options  were  modified  so  that  they  would 
"know"  which  VG  they  were  running  on,  thus  enabling  them  to  utilize  the 
proper  code. 

oo  PARCOV 


This  routine  calculates  the  covariance  matrix  of  a given  class  in  an 
OLPARS  data  set.  When  operating  on  large  data  sets  it  was  found  to  lack 
sufficient  accuracy.  It  was  modified  to  utilize  double  precision  floating 
point  instead  of  single.  Also,  the  calculations  are  being  performed  in 
blocks  to  guard  against  overflows.  This  new  version  was  implemented  through- 
out the  system. 

oo  SEGMENTATION  MODULE 

This  module  allows  the  user  to  automatically  segment  a given  waveform  or 
node  with  respect  to  some  criteria  i.e.,  threshold,  zero  crossings,  etc.  The 
original  dialogue  between  the  user  and  the  system  was  found  to  be  clumsy  and 
time  consuming.  For  this  reason  the  user-system  dialogue  was  redesigned. 
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oo  TEXT 


The  routines  which  retrieve  and  store  text  information  were  never  modi- 
fied to  conform  with  the  current  data  set  philosophy  now  employed  under  WPS. 
Under  this  effort  the  necessary  changes  were  implemented. 
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SECTION  5 
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NOTES  ON  OPERATIONAL  PROCEDURES 

During  the  course  of  getting  to  know  a system  certain  procedures  arise 
as  being  the  best  way  to  accomplish  a certain  task.  These  opei^tional  pro- 
cedures are  rarely  ever  set  down  in  writing,  but  instead  go  into  making  an 
experienced  operator.  This  is  an  effort  to  enumerate  some  good  operating  j 

procedures  for  using  the  Waveform  Processing  System. 

o Incredible  as  it  sounds,  many  novice  users  find  that  the  system 
fails  to  materialize  after  the  "RUN  WPS"  command  has  been  given, 
due  to  failure  of  the  "VG"  to  be  turned  on.' 

o One  of  the  most  efficient  ways  of  locating  a system  problem  is 
to  dump  all  of  the  tables  on  the  line  printer.  If  the  system 
is  up,  the  user  can  use  the  "OUTPUT"  frame,  if  the  system  does 
not  respond,  use  "PRNTBL".  This  is  a stand-alone  routine 
which  runs  under  "DOS". 

o The  hard-copy  option  is  now  an  overlay  and  not  a subroutine. 

As  such  the  user  can  no  longer  invoke  this  function  when 
sitting  in  the  middle  of  an  overlay  at  a question  and  answer 
point. 
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When  using  the  edit  module  it  is  imperative  that  the  node  con- 
taining the  waveform  to  be  altered  be  opened  as  opposed  to  the 
whole  tree. 

Control  - X is  a handy  way  to  escape  from  an  option  that  was 
wrongly  selected  and  is  now  asking  for  user  input.  Even 
though  many  precautions  are  taken  it  is  still  dangerous  to  use 
this  function  to  kill  a routine  that  is  executing. 

If  the  execution  of  a "PARLAN"  program  comes  to  an  abnormal 
conclusion,  it  is  invisible  to  the  user  that  one  or  more  files 
may  have  been  left  open.  To  make  sure  that  every  filing  system 
table  is  initialized,  do  a "CONTROL  T"  and  rerun  WPS. 

Operations  on  vector  trees  seem  to  reach  maximum  efficiency 
when  vector  trees  are  kept  short  — around  10  or  12  nodes  maximum. 
In  creating  trees  therefore,  the  practice  should  be  to  create 
many  short  trees  as  opposed  to  one  very  large  structure. 

The  "CURRENT  DATA  SET"  does  not  exist,  only  at  that  point  where 
the  entire  system  has  just  been  built  and  data  set  has  yet  been 
chosen.  Once  "SELECT  DATA  SET"  has  been  run  there  will  always 
exist  some  current  waveform  data  set  with  its  associated  vertical 
and  horizontal  scaling  parameters.  In  essence,  it  can  never  be 
assumed  that  the  default  scaling  parameters  are  being  utilized 
on  a given  display;  always  check  the  scaling. 
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MISSION 

of 

Rome  Air  Development  Center 


RADC  plans  and  conducts  researcht  exploratory  and  advanced 
development  programs  in  coataand,  control/  and  conminicatlons 
(C^)  activities,  and  in  the  areas  of  information  sciences 
and  intelligence.  The  principal  technical  mission  areas 
are  communications , electromagnetic  guidance  and  control, 
surveillance  of  ground  and  aerospace  Objects,  intelligence 
data  collection  and  handling,  information  system  technology, 
ionospheric  propagation,  solid  state  sciences,  microemve 
physics  and  electronic  reliability,  maintainability  and 
compatibility . 
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